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Abstract 

A two parameter generalization of Boltzmann-Gibbs-Shannon entropy based on 
natural logarithm is introduced. The generalization of the Shannon-Kinchinn ax- 
ioms corresponding to the two parameter entropy is proposed and verified. We 
present the relative entropy, Jensen- Shannon divergence measure and check their 
properties. The Fisher information measure, relative Fisher information and the 
Jensen-Fisher information corresponding to this entropy are also derived. The 
canonical distribution maximizing this entropy is derived and is found to be in 
terms of the Lambert's W function. Also the Lesche stability and the thermody- 
namic stability conditions are verified. Finally we propose a generalization of a 
complexity measure and apply it to a two level system and a system obeying expo- 
nential distribution. The results are compared with the corresponding ones obtained 
using a similar measure based on the Shannon entropy. 



PACS Number (s): 

Keywords: Entropy, Relative entropy, Fisher information measure, stability conditions, 
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I Introduction 



Entropy is a very important quantity and plays a key role in many aspects of statistical 
mechanics and information theory The most widely used form of entropy was given by 
Boltzmann and Gibbs from the statistical mechanics point of view and by Shannon from 
an information theory point of view. Later certain other generalized measures of entropy 
like the Renyi entropy pQ and the Sharma-Mittal-Taneja entropy [2|3] were introduced 
and their information theoretic aspects were investigated. Recently in jl] a new expression 
for the entropy was proposed as a generalization of the Boltzmann-Gibbs entropy and the 
necessary properties like concavity, Lesche stability and thermodynamic stability were 
verified. This entropy has been applied to a wide variety of physical systems, in particular 
to long-range interacting systems [5116] and nonmarkovian systems [7]. 

Most of the generalized entropies introduced so far were constructed using a deformed 
logarithm. But two generalized entropies one called the fractal entropy and the other 
known as fractional entropy were proposed using the natural logarithm. The fractal en- 
tropy which was introduced in [5] attempts to describe complex systems which exhibit 
fractal or chaotic phase space. Similarly the fractional entropy was put forward in [9] 
and later applied to study anomalous diffusion [10]. Merging these two entropies in our 
present work we propose a fractional entropy in a fractal phase space. Thus there are 
two parameters one parameter characterizing the fractional nature of the entropy and 
the other parameter describing the fractal dimension of the phase space. Thus the func- 
tional form of the entropy depends on the natural logarithm. We give the generalized 
Shannon-Kinchinn axioms corresponding to this two parameter entropy and prove that 
they uniquely characterize our entropy. The two parameter relative entropy and the 
Jensen Shannon divergence measure are also generated. The generalized Fisher informa- 
tion is derived from the relative entropy. Relative Fisher information measure and its 
associated Jensen-Fisher information measure corresponding to this entropy are also pro- 
posed. The thermodynamic properties like the Lesche stability and the thermodynamic 
stability are also verified. We notice that the probability distribution which maximizes 
this entropy is expressible in terms of the Lambert's ^-function. Finally we set up a 
two parameter generalization of the well known complexity measure LMC (Lopez-Ruiz, 
Mancini and Calbet) complexity measure [TT] and apply it to a two level system and an 
exponential distribution. 

After the introduction in Section I, we introduce our new two parameter entropy in 
Section II and investigate its properties. In Section III the relative entropy and the Jensen- 
Shannon divergence measure corresponding to this two parameter entropy is presented 
and its properties are studied. Using the relative entropy the Fisher information measure, 
the relative Fisher information and the Jensen-Fisher information are also obtained. The 
thermodynamic properties are analyzed in Section IV. In section V we present a two 
parameter generalization of the LMC complexity measure and analyze the complexity of 
a two level system and a system with continuous probability distribution. We conclude 
in Section VI. 
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II Generalized entropy and its axiomatic characteri- 
zation 



The Boltzmann-Gibbs-Shannon entropy which is an expectation value of ln(l/pj) is gen- 
erally expressed as 

S BG = (Hl/pi)) = k ^pi(-lnpi), (2.1) 

i 

where pi represents the probability and k is a constant. A new form of entropy based on 
the natural logarithm was proposed in [8] considering p\ as the effective probability i.e., 
X^pf = 1 to take into account incomplete information. The entropy thus defined 

S =(ln(l/ Pi )) q = J2Pi(-^Pi), (2-2) 

i 

makes use of the g-expectation given below: 

(0) 9 = 5>?0- (2.3) 

i 

The g-expectation value (12. 3p characterizes incomplete normalization [5] which is known to 
occur in complex systems. Later to account for the mixing which occurs due to interactions 
between the various states of the system, the same form of the entropy but with the regular 
conditions on the probabilities i.e., YliVi — 1 was discussed in [T2~|IT3"] . 

The Boltzmann-Gibbs-Shannon entropy can also be defined through the equation 

(2.4) 

2 = 1 

Replacing the ordinary derivative by the Weyl fractional derivative a new entropy was 
obtained by Ubriaco in [9]. The functional form of the entropy which is an expectation 
value of (\n(l/pi)) q reads: 

S = £>(-ln ft )« ee ((ln(l/ ft ))«>. (2.5) 

i 

A salient feature of the fractal entropy (12. 2p and the fractional entropy (12. 5p is that they 
are functions of the ordinary logarithm unlike the other generalized entropies [Ifl4|ll5] 
which are defined through the use of deformed logarithms. 

Inspired by fractal entropy (12.21) and the fractional entropy (12. 5p we propose a two 
parameter generalization of the Boltzmann-Gibbs-Shannon entropy 

w w , v q> 

i=i i=i V Pi ' 

where k is a generalization of the Boltzmann constant and q and q' are the parameters 
which are used to generalize the BGS entropy. The entropy (I2.6P can be considered as a 
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fractional entropy in a fractal phase space in which the parameter q comes from the the 
fractal nature and the parameter q' is from the fractional aspect. 

In the q — >■ 1 limit the entropy (12.61) reduces to the fractional entropy (12. 5p . Similarly 
we recover the fractal entropy (I2.2p in the limit q' — V 1 and the BGS entropy when both 
the parameters attain the value of unity. A very interesting limiting case of the (12.61) 
occurs when we set q = q' 



w w / ^ \ q w 

S q (p i ) = kY t Pt{-^Pi) 9 = kY^Pt[^-) ^E^' (2.7) 

i=l 8=1 ^ 8=1 

where sf is the single particle Boltzmann entropy. The one parameter entropy (12.71) is 
the sum of biased single particle Boltzmann entropy. At this juncture we would like to 
make a remark about the Boltzmann entropy and the Gibbs entropy. An explanation 
in [16] states that the Boltzmann entropy is the iV sum of the entropy calculated from 
the one particle distribution, whereas the Gibbs entropy is computed directly from the 
iV-particle distribution. This implies that the Boltzmann entropy and the Gibbs entropy 
are the same only when the systems are noninteracting. Looking into equation (12. 7p from 
this point of view we realize that this entropy can be understood in a similar setting, i.e., 
the one parameter entropies are biased by a parameter q and this bias may be due to 
the presence of interactions. Such a behaviour strongly resembles the characteristics of 
complex systems in which the behaviour of the total system is different from the single 
particle system due to presence of interactions. So we assume that the entropy (12. 7p 
described above may be a strong candidate in describing complex systems. 

Below we present the two parameter generalization of the Shannon-Kinchinn axioms. 
Let A n be an n-dimensional simplex as defined below 



A„ = { (Pi, ■■■ i Pn 



Pi 



> 



i=l 



0,J> = ll, (2. 



in which the two parameter entropy (12. 6p satisfies the following axioms. 

(i) Continuity: The entropy S m * is continuous in A n . 

(ii) Maximality: For any n G N and any (pi, . . . ,p n ) G A n 

S q , q >(pi, ...,p n )< S 9>q > . . . , ij . (2.9) 

(Hi) Expansibility: 

Sq,q>(Pl,-;Pn,fy = Sq,q> (Pi , ■■ Pn) ■ (2.10) 

(iv) Generalized Shannon additivity: 

» 3 i 3 

+ E (fc) (E^wE^^'i^ +E s «>9 , - fc ( pi )E s 9' fc ^'i*^)) 

fe=l ^ ' i j i j 
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where 



Sq,q'(Pi) =Pi(- ln PiY 



= S (ft). 



(2.12) 



The factor p(j [i) = Pij/pi appearing in (I2.1ip is the conditional probability i.e., probability 
of occurence of a j th event when a particular i th event has occured. 





0.1 D.2 D.3 D.4 0.5 0.6 0.7 0.3 0. 



Figure 1: In the following graphs we show that the entropic function defined in (12. 6p is 
concave for various values of q and q'. The first two graphs in the top row are plotted for 
various values of q' keeping the value of q fixed at 0.9 and 1.1 respectively. The next set 
of graphs are plotted for various values of q keeping the value of q' fixed at 0.9 and 1.1. 



A Concavity: 



The two parameter entropic functional (12. 6p has an extremum at Pi 
the second derivative w.r.t Pi is 



d 2 S 



dp} 



—q exp 



-q/q' 



g'(2 - q' 

q 



q'-2 



exp(— q/q 1 ) and 



(2.13) 



From (I2.13P it can be observed that the second derivative of the entropy is uniformly — ve 
in the region (q, q') > implying that the entropic functional is uniformly concave for 
q, q' G M + . The various limiting cases arising out of the two parameter entropy viz the 
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fractal entropy (12. 2p . the fractional entropy (12. 5 p and the one parameter entropy (12 .7p are 
also concave only when the deformation parameters are greater than zero. We illustrate 
the concavity of the entropic function through a set of plots shown above. 



B Generalised form of Shannon additivity 

Let Pij be the probability of occurence of a joint event, in which p t and pj are probability 
of occurence of the individual events. The two parameter entropy corresponding to the 
joint probability p^ can be written as 

S q ,APij) = 5>« (" ln ^' = E (pWYp! ( - In (ft P(m ) 9 ■ (2.14) 



Expanding the logarithm in the above equation using the binomial theorem and isolating 
the k = term we arrive at 

Sq,q'{Pij) =J2 S ™'( Pi ">Yl( P (i\ i }Y + J2 (/J E S 9.9 / -*(P*)S S ff,fc(pO'l i ))> ( 2 ' 15 ) 
j j fc=l ^ ' i j 

where Q.) denotes the binomial coefficients. Since the system is symmetric in p^ and 
the binomial expansion of eqn (I2.14p can be written in an equivalent form as 

Sq,q'(Pij) = ^Pl^^q'iPUl'i)) + ^ K J E (ft) E Sff.g'-k {p(j ■ ( 2 -16) 

Adding (I2.15P and (I2.16P the modified form of Shannon additivity is obtained 

s q ,APij) = ^(E^^E^i^+E^E^ww) (2-i7) 

fc=l ' j j i j 

When the two events are independent i.e., the joint probability obeys the relation 
Pij = PiPj eqn (I2.17P simplifies into 



+ (^j (S q ,k(Pi) S q,q'-k{Pj) + Sq,q'-k(Pi) S q ,k(Pj))^ • ( 2 -18) 



where Mj(g) = 1 — J^iPi * s the m i xm g between the various states and occurs due to the 
fractal nature of the phase space. The Shannon additivity relations corresponding to the 
various limiting cases of our two parameter entropy (12.61) are listed below for the sake of 
completeness. 



5 



Special cases corresponding to the various one parameter entropies: 

(i) In the q — y 1 limit the generalized Shannon additivity corresponding to the fractional 
entropy (I2.5P is obtained 

i i j 

+ [ q k )( s k&)s q '-k(p(3\i)) + s q >-k(j>i)s k (p(j\i)j)\ (2.19) 

i j k=i \ ' ' 

When the joint probability of system p^ obeys the relation p^ = PiPj, we recover the 
pseudoadditivtiy relation proved in [9]. 

(ii) The generalized Shannon additivity corresponding to the fractal entropy (I2.2p is re- 
covered in the q' — >• 1 limit 

i j i j 

and the pseudoadditivity relation corrresponding to this entropy given in [T2] can be 
obtained under the condition = PiPj. 

(Hi) The generalized Shannon additivity relation corresponding to the one parameter 
entropy (12. 7p in the q' —¥ q limit has the form 

^ i j i j k=l ' 

+pr\pm) k s k {Pi)s q ^{p{m) + YlpiH s Mm)- (2.21) 

i j 

Imposing the condition pij = p^j we can get the following pseduoadditivity relation 

s 9 M = UsM + sM-M^sM-MiWsM 



+ (l) (s q -k(Pi)S k ( Pj )(l - M t (k))(l - Mj(q - k)) 
k=l ^ ' ^ 



+S k ( Pi )S^ k ( Pj )(l - M t (q - fc))(l - Mjik^j j . (2.22) 
C Uniqueness of the two parameter entropy 

In this subsection we prove the uniqueness of the two parameter entropy which obeys the 
modified form of the Shannon additivity given in (12.171) . It can be noticed that (12.171) is 
a symmetrized combination of the following two equations 

Y^SqrfiPti) = E s 9,9'fe)(p(jK)) 9 + E ( 9 k j ^s q ^. k {pi)s q ^{p(j\i)) (2.23) 

i,j i,j k=l V ' i,j 

Y^ s i,i'(Pij) = ^P^^'ipU^)) + Y1 Uj ^2 s iAPi) s Q,g'~k(pU\i))- (2.24) 



We come to this conclusion, since in (I2.17P there is a Pi <H- p(j\i) symmetry between the 
first and the second term and also between the two terms within the k summation. Since 
the Ihs in (I2.23P and (I2.24p are equal, the rhs of these equations should also have matching 
individual terms. This implies that s q ^(pi) = p\ and also that the entropic function s q>q i 
can be separated in the form of s q s q '. Since we already know that s q (pi) = s q)0 (pi) = p\ 
what remains is to find the functional form of s q >(pi). Using the separable form of the 
entropy and the structure of s q in (I2.23P we arrive at 

X>S *<M = I>& + E (t) E pl*<-M*k(pU\ty- ( 2 - 25 ) 

i,j i,j k=l * i,j 

This can be rewritten in the following form 

E4-V(Pii) = E (!) E P%^-kipi)B k (p{j\i)). (2.26) 

i,j k=0 ^ ' i,j 

Comparing the coefficients of p\^ we get 

s q ,(p t3 ) = (s(p i )+s(p(j\t))) q ' . (2.27) 

The only function which satisfies the form shown above is the logarithm. The entropy 
is a positive function, whereas the probabilities can take only the values < Pi < 1, so 
this leads to the conclusion that s q >(pi) = (}ia(l/p i )) Q . Combining the two parts of the 
entropy s q (pi) and s q >(pi) we get (12.61) the form of the entropy. 

Finally for the sake of completeness we define the conditional entropy of a pair of 
discrete random variables (X, Y) with a joint distribution p(x, y) as 

s q j(x\Y) = J2p( x >y) q (- l Mx\y)) 9 \ (2.28) 

x,y 

where p(x\y) denotes the conditional probability. 



Ill Generalized Divergence Measures 

Divergence measures play an important role in Information theoretic analysis of any en- 
tropy, since the probability distribution of a random variable cannot always be found 
exactly and also due to the reason that sometimes it is necessary to find the difference 
between two distributions. For the Shannon entropy several such measures like the Kull- 
back Liebler relative entropy, Jensen Shannon divergence, etc., have been introduced and 
investigated in detail. In this section we define these measures for the two parameter 
entropy proposed in the previous section. 



A Relative entropy 

If P = {px, . . . , Pn} and *P = {pi, . . . , p n } be any two probability distributions, the two 
parameter relative entropy corresponding to these distributions is defined as 
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where q and q' are the generalizing parameters. In the limit q — > 1 we recover the fractional 
relative entropy and in the limit q' — > 1 the fractal relative entropy can be obtained. In 
the case where q' = q we obtain the Kullback relative entropy corresponding to the one 
parameter entropy described in (12 .7p . When both the parameters are set to unity we get 
back the Kullback relative entropy. 

Below we list the properties of the two parameter entropy and prove them. 

(i) Nonnegativity: £> 9i9 /(P||*P) > 0. 

(ii) Continuity: D g 5 /(P||?P) is a continuous function for the 2n variables. 

(Hi) Symmetry: The relative entropy is symmetric under the simultaneous exchange of a 
pair of variables in the distributions P and *P 



Dq,q>(pi, ■ ■ ■ , Pjf, • • • , Pfc, • • • , Pn||pl, • • • , Pj, ■ ■ ■ , Pk, ■ ■ ■ , Pn) 

, Pj, ■ ■ ■ , Pn||pl, • • • , Pk, ■ ■ ■ , Pj, • • ■ > Pn)- 



— D qt g>(pi, . . . , Pfc 

(iv) Possibility of Extension: 

D q , q '(Pl, • • • , Pn,0||pl 

(v) Pseudoadditivity: 

/V( p(1) x p( 2 )||*p« xyW) 



, Pn||pl, 

,p n ,0) = D M /(pi, . . . , P„||pl, • • • ,pn) 



(3.2) 
(3.3) 



Ud^W^) ~ MM)D q A? {1) n {l) ) (3-4) 
+D qiql (pW\\<$W) - Mi(q)D q j(pW\\y&>) 

+Eff)(^( p(1) iiv (1) )^-*(p (a) iiv w ) 



where P« x P< 2 ) = {a^af^a^ G P®,j = 1,2} and 

*p(D x <#W = {b^bflb^ e = 1,2}. 
(vi) Joint q-convexity: 

^'(AP (1) + (l-A)P (2) ||Aq3 (1) + (l-A)q3 (2) ) < A^(P«||q3«) + (l-A)^(p( 2 )||^ 2 )). 

(3.5) 

Proof: 

The convexity of the relative entropy function (13.11) proves the first axiom. Axioms (ii), 
(Hi) and (iv) can be trivially proved. The expression for pseudoadditivity in (v) follows 
from direct calculation. The relative entropy satisfies the joint g-convexity stated in axiom 
(vi) proposed in Reference [T7j. To prove the joint g-convexity we use the generalized form 
of the log-sum inequality 



n , s q' n 



\ 



In 



(3.6) 



8=1 



This inequality can be obtained from g-generalization of Jensen inequality proposed in 

Since the relative entropy (13. ip is not symmetric in P and we define the following 
symmetric measure 

V(P.V) = \ (^(PIIVJ + ^CVIIP)), (3-7) 

which shares most of the properties of the relative entropy. It can be noticed that the 
Kullback Liebler relative entropy (13. ip is undefined if the distribution *p = and P ^ 0. 
Similarly the symmetric form of the relative entropy ( 13. 7p is undefined if any of the 
distribution vanishes. This implies that the distribution has to be continuous with 
respect to the distribution P for the measure (13. ip to be defined. For the case of the 
symmetric measure the distributions and P have to continuous with respect to each 
other. 

To overcome this a modified form of the relative entropy is defined between the distri- 
bution P and a distribution which is a symmetric sum of both P and *}3. The mathematical 
expression corresponding to the modified relative entropy is 

V 9 AP, V) = D m , (P|| (P + g)/2) = Pf ( ln {pi + P p i)/2 ) 9 ■ ( 3 - 8 ) 

The alternative form of relative entropy proposed in the above equation is defined even 
when *P is not absolutely continuous with respect to the distribution P. Though it satisfies 
all the properties of the Kullback Liebler relative entropy it is not a symmetric measure. 
So, a symmetric measure based on ( 13. 8 p is defined as follows: 

j q A?^) = \{v q Am) + v q AW)) ■ (3-9) 

which is a generalization of the Jensen Shannon divergence measure [18] corresponding 
to the two parameter entropy (12. 6p defined in the previous section. 

The symmetric measure based on the relative entropy (13 ,7p and the generalized Jensen 
Shannon divergence measure (13.91) satisfies the following properties 

J q , q >(P,W) > 0, 

V(P,<P) = 0^P = <p, (3.10) 

where J qA > can be either J M / or J qA '. The symmetric form of the relative entropy and 
the Jensen Shannon divergence measure are related via the expression 

Jq,q> < ^7 -W, (3-11) 

which clearly shows that the upper bound to the Jensen Shannon divergence is given by 
the symmetric form of the relative entropy. A similar relationship also exists between 
the (I3.8p and (13. ip in which the relative entropy defines the upper bound of the modified 
relative entropy. 
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B Fisher information measure 



The Fisher information measure for a continuous random variable X with probability 
distribution p(x) is defined as: 



p(x) 



1 dp(x) 
p(x) dx 



dx 



1 dp(x) 
p(x) dx 



— \np(x' 
dx 



(3.12) 



In Reference [19], the Fisher information was obtained from the Kullback Liebler relative 
entropy in the following manner: The relative entropy between a uniform probability 
distribution p(x) and its shifted measure p(x + A) is constructed. The integrand is then 
expanded as a Taylor series in the shift A upto second order from which the Fisher 
information measure is recognized. Analogously we proceed to derive the q, g'-generalized 
Fisher information measure using the two parameter generalized relative entropy proposed 
in the previous subsection. The two parameter relative entropy between the measure p{x) 
and its shifted measure p(x + A) is 



D q ,q' (p{x) \\p{x + A)) = J (p(x)Y ( - In 



p(x + A) 
p(x) 



dx. 



(3.13) 



In the above equation, the function lnp(x + A) is expanded upto second order in A and 
the resulting expression is written in terms of a binomial series as follows: 



D q>q ,(p(x)\\p(x + A)) 



A"' 



y q 



k=0 



p'(x) 
p(x) 



q'-k 



A f fp'(x) 



p"(x) 
p(x) 



dx. 
(3.14) 



Considering the first two lower order terms in A 



D qiql (p(x)\\p(x + A)) 



(p(x)y 



A q 



p'(x) 
p(x) 



+ 



<*') ( (pM) q,+l _ (p'^y^p"^) ) \ 



p(x) 



p ql (x) 



dx(3.15) 



and in comparison with the method adopted in Ref. [19], we obtain the two parameter 
generalization of the Fisher information measure 



(p(x)) 



q-q'-l 



dp(x] 
dx 



q'+l 



dx. 



(3.16) 



Along the lines of eqn (I3.12p the above expression can be defined through a g-expectation 
value as 



1 dp(x) 
p(x) dx 



q' + V 



dx 



q'+V 



(3.17) 



The Fisher information measure (I3.17P make use of the g-expectation and in the q' — > 1 
limit it reduces to the expression obtained in 
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C Relative Fisher information and Jensen Fisher divergence 
measure: 

The relative Fisher information measure between two probability distributions p\ (x) and 
P2{x) is given by 

RM ^(±^y +l ) r J^ x)Y {±y£^ ix . ( 3,s) 

The above relation is not symmetric and so we define 

X ml (p l ,p 2 ) = -(Rlq,q'(pi,P2) + Rjq,q> (P2, Pi ) ) , (3-19) 

which is a symmetric extension of (I3.18p . The disadvantage with these measures is the 
following: Equation (I3.18P requires the distribution P2{x) to be a continuous function of 
Pi(x) for a given x and relation (I3.19P requires the distributions p±(x) and P2(x) continuous 
with respect to each other. 

To surmount this the relative Fisher information is defined between the distribution 
Pi(x) and a new distribution between (pi +p 2 )/2 and the expression for this modified 
form reads: 

\ q>ql (PuP2) = R Iq,q> (ft,^) = /W))' (i^ {pi{x "l% ))/2 ) 

(3.20) 

A two parameter generalization of the recently proposed Jensen Fisher divergence 
measure, can be constructed via a symmetric combination of the modified form of the 
relative Fisher information. The form of the generalized Jensen Fisher divergence measure 
so constructed is 

Jq,q'{Pl,P2) = g = 2 ' 

The Jensen Fisher measure (13.211) is convex and symmetric and vanishes only when both 
the probabilities p\{x) and p2{x) are identical everywhere. 

Finally we discuss the relevant limiting cases: All the information measures defined 
in this section reduce to the corresponding measures obtained through the use of the 
Shannon entropy in the q, q' — > 1. In the q — » 1 limit the information measures relevant 
to the Fractional entropy is recovered. The q' — > 1 limit leads to the information measures 
of the Fractal entropy. 

IV Thermodynamic properties 

The canonical probability distribution pi can be obtained by optimizing the entropy sub- 
ject to the the norm constraint and the energy constraint. Adopting a similar procedure 
for our two parameter entropy (12. 6 \ we construct the functional 



L = ^$(pi]q,fl-a^2pi-lj -p(^2Pi e i~ E J, <5>(Pi;q,q') =Pii-ln Pi ) q ', 



(4.1) 
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where a and (3 are the Lagrange's multiplier and £j is the energy eigenvalue and E is the 
internal energy. Employing the variational procedure we optimize the functional in (14. ip 
with respect to the probability to get 

— = &(p i -q,q')-(a + Pe i ), (4.2) 

OPi 

where Q'ijPi, q, q') is 

q, q') = qp^\- - q'pf^- Inp^K (4.3) 

When the functional L attains a maximum its variation wrt pi is zero and using this in 
( 14. 2p yields the inverse of the probability distribution 

qpl\-\n Pi y' -q'pl'i-lnp^'- 1 = (« + /3e,). (4.4) 

Inversion of the relation (I4.4p to obtain the probability distribution is not analytically 
feasible, so we adopt a different method to derive the distribution. Since we have already 
set 5L/5pi to zero, we can integrate (14 .2p to get 

HPi-,Q,q') = {a + fle^Pi. (4.5) 

Substituting the entropic expression (12.61) in (14 .5p and comparing this with the equation 
for Lambert's H^-function z = we w we obtain the relation for the probability 

i 

z= l -^-{a + Pe l )V. (4.6) 

The factor W(z) is the Lambert's ^-function also known as the product log function. 
For real z the function contains two branches denoted by Wq(z) and W-i(z). The branch 
W / o(^) satisfies the condition that W(z) > — 1 and is generally known as the principal 
branch of the ^-function. When W(z) < —1 we have the W_i(z) branch. The Lambert's 
jy-function occurs naturally in both classical [2T] and quantum statistical mechanics 
[22|23] as well as in nonequilibrium statistical mechanics [21]. Very recently its connection 
to the field of generalized statistical mechanics has been established through the following 
works [T2"ir2~5 .26j. which our current result emphasizes. 

Lesche stability: 

A stability criterion was proposed by Lesche |28.29j to study the stabilities of Renyi 
and the Boltzmann Gibbs entropy. The motivation for this criterion goes as follows: An 
infinitesimal change in the probabilities Pi should produce an equally infinitesimal changes 
in an observable. If p and p' be two probability distributions, Lesche stability requires 
that Ve > we can find a 5 > such that 

X>-p;i<^^4^^< £ . (4.7) 
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Using (14 .7p a simple condition was derived in [30] for any generalized entropy maximized 
by a probability distribution. This condition which is widely used to check the Lesche 
stabilities of generalized entropies reads: 



S q , q '{p') - S qiq/ (p) 



< 



C^lpi-p'jl, (4.t 



where the constant C is 



C' 

a w> j= i 

f-i(0+) - f- l (i-) 
C = J { f 1 ' . (4.9) 

/- X (0 + ) - Jo 

The function f~ 1 (p) is the inverse probability distribution obtained in (I4.4p . In order to 
compute the constant we integrate the inverse probability distribution with respect to the 
probability 

/ r 1 {p)dp= [ {qp q -\-\np) ql -q'pi-^-lnpY'-^dp. (4.10) 
Jo Jo 

The rhs of (14.101) consists of two integrals in p and by using the transformation hip = —y 
they are obtained in terms of the gamma function. A simple calculation helps us to see 
that these two integrals are in fact the same and so J Q f~ 1 {p)dp = 0. Similarly it can also 
be noticed that the / _1 (1~) = due to occurence of the natural logarithm. So we finally 
get the value of C as 

f _1 (0 + ) 

C = TW) = 1 > (411) 

which leads to the conclusion that for our case 5 = e and so the criterion for Lesche 
stability is satisfied. 

Thermodynamic stability: 

The thermodynamic stability conditions of the Boltzmann-Gibbs entropy can be derived 
from the maximum entropy principle and its corresponding additivity relation. In Refer- 
ences [3Tf32] it has been shown that concavity alone does not guarantee thermodynamic 
stability for the two parameter entropy (I2.6p . We derive the stability conditions for the 
two parameter entropy a la the method developed in [32] ■ The pseudoadditive relation 
for the two parameter entropy reads: 

S q ,AA B) = \ (s q , (A) S q , ql (B) + S q , (B) S q>q ,(A) + g (jQ (s 9 *(A) S q ^ k {B) 

+S q>q ,- k (A)S q , k (B))). (4.12) 



Considering an isolated system comprising of two identical subsystems of energy U in 
equilibrium, the total entropy of the system would be S qtq i{U, U). Allowing for an exchange 
of energy AU from one subsystem to the other subsystem the total entropy changes as 
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Sq, q '(U + AU, U — AU), whose pseudoadditive relation following (I4.12p is 

S g>q ,(U + AU,U-AU) = Us qfi (U + AU)S q>q/ (U-AU) 

+S q>0 (U - AU)S q>q ,(U + AU) 
+ ( f) { S ^ U + Af/ ) s ^'-k(U - AU) 

k=l ^ ' 

+S q , q ,_ k (U + AU) S q , k (U - AC/)) ) . (4.13) 
Similarly, the pseudoadditive relation corresponding to S q>q /(U,U) obtained using (14.121) 



is 



S q ,AU, U) = \ (s q , (U)S q , ql (U) + S q , (U)S q , q ,(U) + g (jQ (s q , k (U)S q , q ,„ k (U) 

+S q , q ,- k (U)S q , k (U))). (4.14) 



From the maximum entropy principle we know that 

S q , q > (U,U)> S q , ql (U + AU, U - AU). (4. 15) 

Expanding (14. 13p upto second order in AU and using the maximum entropy principle 
(I4.15p . we get the following condition 

n v. q d 2 Sq,q' 9S q fi BSgrf 1 \^ ( ( q ^jV-j q ^Sg^> 

k=l v 7 v 

The two parameter entropy can be connected to its first and second derivatives via recur- 
rence relations which be substituted in Eqn. (I4.16P to yield the simplified form 

> ^Jf - (1 - q) ((2"' - q)S q , q , + q'(2* + 2q + l) S^-l + (/ + q' + 2"')S q , q ^ 2 ) . (4.17) 

From (I4.17P we notice that in the rhs, the first term is negative in the region q, q' > due 
to the concavity conditions imposed on the entropy. From the rest of the terms we notice 
that the stability conditions will be respected when either < q < 1 and q' > log 2 q or 
q > 1 and q' < log 2 q. Under the limiting conditions of q, q' — Y 1, we recover the concavity 
condition for the Boltzmann entropy which is also the thermodynamic stability condition 
for the Boltzmann Gibbs entropy. 

Generic example in the microcanonical ensemble: 

An isolated system in thermodynamic equilibrium can be described via the microcanonical 
ensemble. In a microcanonical picture all the microstates are equally probable. Under 
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conditions of equiprobability i.e., Pi = Vz G (1, W) the two parameter entropy (12. 6p 
becomes 

S q>q > = kW x - q {hiW) q \ (4.18) 

where W is the total number of microstates. In the limit q — > 1 the above expression (14.1 8p 
reduces to the microcanonical entropy derived from the fractal entropy (12.21) . Similarly 
in the q' — > 1 limit we can obtain the entropic expression corresponding to the fractional 
entropy ( 12. 5p . When we set q' = q we can get the microcanonical entropy corresponding 
to the entropy in ( 12 .7p . For the entropy ( I4.18P the temperature is defined through the 
relation 

h = f§ = k w ~ q (ln w)q '~ 1 (g/ + (1 _ q) ln w + g,) w- (4 - 19) 

The definition of temperature corresponding to a generic class of systems for which the 
density of states W is related to the energy via the expression W = CE? is found to be 

A = kfC 1 - q E^- q)i - 1 (\nCE f ) q '- 1 {q' + (1 - q) hxCE f ). (4.20) 

An analytic inversion of (I4.20p to obtain the energy as a function of temperature is not 
feasible. Though the above illustration is given only for the microcanonical ensemble a 
direct extension of this method to include other kinds of adiabatic ensembles can be easily 
achieved. 



V Complexity Measures 

Physical systems in which the behaviour of the total system cannot be constructed from 
the properties of the individual components is generally defined as complex systems. 
Several measures were proposed to quantify complexity of physical systems [53fll|34] . 
One such measure is the disequilibrium based statistical measure of complexity popularly 
referred to as LMC (Lopez-Ruiz, Mancini and Calbet) complexity measure which was 
introduced in [11] . This measure is based on the logic that there are two extreme situations 
in which we can find the simple systems, one is the perfect crystal in which the constituent 
atoms are symmetrically arranged and the other limit is the completely disordered system 
which is best characterized by an ideal gas in which the system can be found in any of the 
accessible states with the same probability. The available information is very little in the 
case of a perfect crystal and is maximum for the ideal gas. The amount of information 
in the system can be found using the Boltzmann Gibbs entropy (S). A new quantity 
called the disequilibrium (D) was proposed which is the distance from the equiprobable 
distribution and is maximum in the case of the crystal and zero for an ideal gas. The 
product of these quantities was defined as the measure of complexity. This measures 
vanishes for both perfect crystal and the ideal gas. 

For a system consisting of N accessible states with a set of probabilities {pi,P2, ■■-,Pn}, 
obeying the normalization condition YliLi Pi = 1 ^ ne complexity measure reads: 



C = S D, 
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The LMC measure of complexity was found to be a nonextensive quantity. A generalized 
measure of complexity was proposed in [35J based on Tsallis entropy with a view to absorb 
the nonadditive features of the entropy. Similarly a statistical measure of complexity 
corresponding to the two parameter entropy (12.61) is defined as follows: 




In the limit q, q' — > 1 we recover the LMC complexity measure proposed in [TT] . The 
LMC complexity measure corresponding to the fractal entropy and the fractional entropy 
are obtained in the q' — > 1 and q — y 1 limits. When we let q' = q, the complexity measure 
corresponding to the entropy (12. 7p is recovered. 

As an example let us consider a two level system with probabilities p and (1 — p). The 
expression for the entropy and the disequilibrium measure are as follows: 

S q ,Ap) = - (Plnp + (1 - p) ln(l - p)) , D(p) = 2(p - 1/2) 2 . (5.3) 

The statistical complexity computed from these quantities 

C q , ql (p) = -2 (plnp + (1 - p) ln(l - p)) (p - 1/2) 2 , (5.4) 

is plotted below for the sake of analysis. 




0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 



Figure 2: In the above graphs we plot the complexity measure C q>q i with respect to the 
information S q ^. In the first plot we compare the LMC complexity measure for a two 
level system for the Boltzmann Gibbs entropy, the fractal entropy, the fractional entropy 
and the two parameter entropy (I2.6p . In the second graph we plot the LMC complexity 
measure for various values of the parameters q and q'. 

From the plots we notice that the complexity measured using the Boltzmann Gibbs 
entropy, fractal entropy, fractional entropy and the two parameter entropy for the perfectly 
ordered state (crystal) goes to zero uniformly. The largest complexity is achieved for 
the two parameter entropy followed by the fractal entropy, fractional entropy and the 
Boltzmann Gibbs entropy. Also, the entropic value for which the maximum value of 
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complexity is reached differs for the different entropies. The complexity zero corresponding 
to the disordered state occurs at various values of the entropy for the different entropies 
and the BG entropy reaches the zero first, followed by the fractional, the fractal and 
the two parameter entropies. For the two parameter entropy, the largest complexity is 
achieved more quickly by varying the fractal index q rather than the fractional index q'. 
Also the zero complexity state corresponding to the disordered system is attained more 
quickly when the fractional index q' is greater than one. 

This measure can be extended to continuous probability distribution p(x) obeying 
the normalization condition J™ p(x)dx = 1. For these distributions the summation 
over the states in the entropic definition is replaced by a integration over x. Similarly 
the disequilibrium measure is D = J™ (p(x) — 1/N) 2 dx. Since there is a continuum 
of states, the number of states is very large and so the disequilibrium measure becomes 
^ = J^oo (p( x )) 2 dx. The two parameter generalization of the LMC complexity measure 
for the continuum case is 

C q>q/ = S q , q , D=(k (p(x)Y (- \np(x)) q ' dx\ (7°° (p(x)) 2 dx^j . (5.5) 

For the purpose of illustration we consider the exponential distribution 

p(x) = v exp(— x/X)(x, A > 0) and calculate the corresponding two parameter entropy 

and its disequilibrium measure 

S M ' = ^r(g' + l,gmA), D=i (5.6) 

The LMC complexity found by substituting (15.61) in (15. 5p reads: 

C q , q , = -^r(q' + l,qln\), (5.7) 

where T(a, b), is the incomplete gamma function in which the lower limit is replaced by a 
positive number. In the limit A — > 1, statistical complexity reduces to 
C q , q , = r(q> + l)/q«'+\ 



VI Conclusions 

A new two parameter entropy based on the natural logarithm and generalizing both the 
fractal entropy and the fractional entropy is introduced. This encompasses an interesting 
limiting case, where the iV-particle entropy can be expressed in terms of a sum of single 
particle biased Boltzmann entropies. The generalized form of the Shannon-Khinchin ax- 
ioms are proposed and verified for this new two parameter entropy. These axioms uniquely 
characterize our new entropy. The corresponding Kullback Liebler relative entropy is pro- 
posed and its properties are investigated. Utilizing the relative entropy a generalization of 
the Jensen- Shannon divergence is also achieved. Exploiting the relative entropy between 
a probability measure and its shift, we derive the generalized Fisher information. Also, we 
obtain generalized forms of the relative Fisher information and the Jensen-Fisher informa- 
tion. The Lesche stability, and the thermodynamic stability are verified for our entropy 
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and we also find that the canonical probability distribution which optimizes our entropy 
can be expressed via the Lambert's W- function. Finally we introduce a generalization 
of the LMC complexity measure making use of our two parameter entropy and apply 
it to measure the complexity of a two level system. The results obtained indicate that 
there is a change in the complexity value with the dominant contribution coming from 
the fractal index q. Finally we also examine an exponential distribution as an example of 
a continuous probability distribution and compute the complexity measure. 

Though we have introduced a new two parameter entropy based on natural logarithm, 
we do not know the specific systems where this can be applied. But from our investigations 
we assume that it will be of use in measuring complexity in fractal systems and systems 
which exhibit fractional dynamics in phase space. Towards this end investigating the 
complexity of probability distributions corresponding to the fractional diffusion equation 
[36] will be worth pursuing. 
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